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ABSTRACT 

Historically, it has been generally accepted that 
evaluation of teaching competencies should be conducted by an 
administrator or a master teacher* There is a body of literature, 
howayer, that expresses the idea that self-assessment may also be a 
valuable source of informat the uncontrollable defense 

mechanisms that may ^ the process. Using the Teacher 

Performance Assessment Instruments (TPAI) developed by the Georgia 
Teacher Assessment Project 7 researchers at the Falk Laboratory School 
at the University of Pi ttsburgh have collected , over a 2-year period , 
both self-evaluation data and assessment data from 22 graduate 

interns in the Master of Arts in Teaching program and the master 
teachers to whom they werf^ assigned. This study's purposes are to 



report the relationships between ^t internVs self-evaluation and the 
master teacher's Mpert assessment and to determine whether the 
self -evaluation process revealed guantifiable growth in competency 
acguisition. Graphs illustrate comparative scores achieved on novice 
teacher versus master teacher evaluations. (Author/JD) 
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Titles THE USEFULNESS AND ACCURACY OF SELF EVALUATION OF TEACHING 
CaMPETENCIES 



Introduct Aon 



Evaluating teaeher performance is certainly not a new trend. 
However, what is n^w im the intense interest in the past ten 
years to improve ways of evaluating teachers (Oldham, 1974). 
Teacher performance evaluation has become an increasingly 
controversial issue^ Early in the history of teacher performanci 
appraisal p educators were evaluated on the basis of traits or 
characteristics (presage variables). These characteristics may 
or may not have been related to performance, and as yet no 
significant body of knowledye attests to the fact that effective 
teaching performance is dependent on specific traits. 
Consequently, many of us discarded this form of evaluation. 

Teacher evaluation has taken on many different compleHionsp 
from process rating scales that evaluated classroom interactions 
to product evaluation that evaluated teachers on the basis of 
student achievement. Currently, teacher evaluation strongly 
emphasises evaluating performance competencies (Oliva ^ Henson, 
19S0| Johnson, 1978. It is generally accepted that performance 
competency evaluation be done by a "superior" or "enpert", 
e - g -, Principal , Director, Superintendent- Perf ormance^based 
evaluation is seen to have several distinct advantages. First, 
identifying performance competencies enables the ^valuatee to 
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knovM Nhat is ©xpected. Secondly, once competeneiem are 
identifiedp i^edknessem can be pinpointed^ 

Presently meveral states have moved toward beginning teacher 
performance evaluation through the use of the Teacher Performance 
Assessment Instruments (TPAI). The TPAI was created by the 
Georgia Teacher Assessment Project and took approHimstely four 
years to develop and test* The TPAI focuses on teacher competence 
in areas such as (1) the teacher's competence in planning 
instruction and choosing materials to achieve instructional 
objectivesi (2) the teacher* s cognitive interaction with learners 
as well as skill in organising and presenting instructional 
activities, and finally (3) the teacher^s in terpersonal skills in 
regard to classroom climate and performance during instruction 
(Tanner Se Ebers, 1985) . 

The Falk Laboratory School at the University of Pittsburgh, 
Pi'ttsburghp Pennsylvania, has been involved in a research project 
for the past five years which has utilized the TPAI in the 
performance evaluation of Master of Arts in Teaching interns. One 
objective of this longitudinal study warn to get the beginning 
teachers more directly involved in the evaluation process (In the 
Betting of a laboratory school, our objective has been to 
transcend the evaluation process and make it more of a growth 
process ) « 

Some areas of the literature on teaching evaluation have 
proposed that, in order to judge teaching competency, the teacher 
himmel f /hersel f mmy be the best source of information^ However, 
it is quite obvious that there may be uncontrollable 
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def enslveneBs built into evaluation bas'^d on *self evaluation' 
(Pine & Boy p 197S) . 

Q bJee tiv ps 

A major goal of nur recent work has been to investigate the 
accuracy and usefulness of self evaluation using portions of the 
TPAI- The objectives of the present study were, first, to 
determine how well the self evaluation correlated with that of an 
expert and second, to determine if quantifiable growth in 
competencies occurred by comparing a self evaluation at the 
beginning of the school year with a self evaluation at the end of 
the year. 

lample 

The sample included twenty^two graduate interns involved in 
the Master of Arts in Tv^aching (MAT) program- The MAT Internship 
in Elementary Education is a graduate program in the Department 
of Instruction and Learning , School of Education, University of 
Pittsburgh, The program is comprised of forty-two credits. It 
extends over four terms beginning with the Summer Session, and 
continues for a full calendar yearp During this year the intern 
spends each week of the school year at Falk School, the 
University's laboratory school. The ISO day clinical eKperience 
at the laboratory school involves teaching responsibilities 
during school hours which are monitored by the master teacher to 
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whom each intern is assigned and formal c ses \ d ^ rter school 
hours. The MAT program is a graduate in wrnship des_= ^ned for 
collega graduates with degrees in libera _ eu c«tlon or 

other professional fields. Successf ^ x ramp rliei the 
Internship Program earns the candidate a s mr of A^ts in 
Teaching (MAT) degree and application for u Pm^nmylvmnxm 
Instruc tional I Teaching Cer ti ficate - 

Data CollBction 

Each MAT intern (novice) was evaluated by the master teacher 
(expert) to whom he/she was assigned- The instrumint^ used to 
assess performance competencies of the interns wert th^ Teacher 
Performance Assessment Instruments (TPAI) Specif icil 1 v y the three 
sections employed were the Teaching Plans and Matiria 1 s , ( TPM ) , 
the Classroom Procedures, (CP), and the Interpersonal Skills, 
(IS), instruments^ The first assessment using the TPM, CP, and 
IS was conducted in the fall, and the second in thi spring. 
Following the Conditions for Use of the TPAI, the fal 1 assessment 
was begun after the 20th school day (actual day of instruc tion ) , 
and was completed on or before the 70th school day* The spring 
assessment was begun after the llOth rchool day, with completion 
on or before the i60th school day (Capie, 1979, ptZQJ - 

Each intern (novice) completed a self evaluation of his/her 
teaching competencies using the above mentioned timi line. The 
instrument used to assess self evaluation of teaching 
competencies was the Competency Perception Su'^vey, (CRS), which 
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Mas designed specifically for this study. The CPS V4mm 
constructed from the TPAI. 

In the TPAI format^ each of the three subtests utiUies 
competency statementSp indicators, and descriptors. Dompetency 
statements are broad statements of responsible perforfnance 
essential to the effective professional conduct of all ttscher 
(Capiei 1979). Competency indicators ^re used in order to defin© 
behaviors representative of the competency. Descriptorij mor& 
specific than either competency statements and indicatorip assess 
to what degree the competency is possessed the teacher - 
Descriptors are usually eHpressed in sentence format and iCaled 
from 1 to 5pi being the lowest rating, and 5 being thi highest 

For eKample, a competency -statement f rom the CP reads as 
folloi/^si COMMUNICATES WITH LEARNERS, The indicator statgei 
Provides Feedback to Learners Throughout the Lesson. Thf 
descriptors statei 

1. Accepts learner ^^omments or performance without fttdback 
about their adenuacv. 

2 Responds to negative aspects of student workp but fe^ 
comments are made about positive aspects - 

3. Inform students of the adequacy of their p^r f orfRince . 

Few errors pass by without being addressed* 
4 Helps learners evaluate the adequacy of their o^n 
performance . 

5, In addition to 4, the teacher probes for the source of 
misunderstandings which arise , 

The content of the CPS was structured to incorporati a 
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r^pres@rt t ativi sample of teaching compettncies contain»«d in the 
TPMp CPp ^nd IS in^^fcrumen ts - The fourtiin competency ^statements 
included in these li — istrumentB form the item content of the CPS* 
Specific ^tattment S^ndicators from each Qf the f ourteeRm 
comp^t#ri£ itatemen^fcm were randomly selected by means ODf a Table 
of Randc^m^ Digits. ^These randomly selectid indicatorm ^^ormed the 
repre^^ht ^tivi sampB.© of teaching competincies cpntain^sd in the 
fourtMn itams of th=ie CPS* The fourteen indicators Ner-^e limted 
in the mavne order as. they appeared on thi respective TF^Al , and 
directicin^s mr^ spec^ified as to how each item should t^^m rated. 
The ratin^gm Wire dor»^ in a non threatening manner , It w^ss common 
knowledge to ill interns that the self fviluation wouj^d be 
conf ident^tal and woumld have no influence on course morl^ grades 

Risultm 

f re-=test as wel 2 am post-test scorei determined by^ the 
novice an* exptrt \^mm^^ not significantly different (Fig^ure 1). 
While th^i~e wai no d^ifference between the novice and %h i pert in 
the tatal mcores ach^ieved there were significant diff%r^«nces in 
the t#lj£r^^ for indi'^widual questions (a iignificant int^eraction 
accurred b-etwien tes^fc question and rater ixperience as erietermined 
by anal/^i s of variai— ice ) , On the pre'-test two question^^ were 
^ited Cliff «rintly by the novice and ©Hpert (Figure 2) ar^d on the 
3oit--'te0t ^htri were also two questions that were rated 
iifferenti^^ (Figure ) * 

When '^he total ^^cores of pre-^t^^st and pomt^temt ra^^fced by the 

...... ...... 
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TOTAL SCORES ON PRE-TEST AND TOST-TKT 
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novice are compared there was m significint imprQV^=men t (Figure 
4). Similarly, master teachers rated the novices ^sts having shown 
significant improvement from the beginning to th^ ^snd of the 
school year. Moreoverp there was no statistical difference in 
the ratings performed by the master and navice te^^^her. 

Novices rated themselves as having shown signS. f leant 
improvement in eight of fourteen variablss (Figure 5), whereas, 
the master rated significant improvement in only th-^ree (Figure 
6) . 

CQnelugion* 

The results of the present study suggest that the self- 
evaluation of competencies by novice teachers is ^ni accurate 
marker of improvement • This conclusion is support©*^^ by two 
statistically significant findings. First, total ^ores for 
evaluation by the novice and enpert were not statis ^ically 
differently on either the pre- or post-test , And s^econd, both 
novice and expert recognized that there was a quan t_^f iable 
improvement in compstency level from the beginning the end of 

the one year internship program- 

Because the ratings of the noyice and eHpert vi^mrm not 
different it appears that def ensiveness on the part of the novice 
did not affect the evaluation process. The assuran&j© of 
confidentiality may have minimiied the development csf a defensive 
attitude during the sel f --evaluation process . 

The perception of deficiencies as will as str#r^gths were 
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NOVI^ MAST^ 



TOTAL SCORES ON mi-TEST AND POrT-TiST 
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similar between the master teacher and the novice . An addi tional 
advantage of the sel f -evaluation system ±m that it provide© m 
framework for formally identifying areas where it is expected 
that competencies be generated - 
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